Optical character recognition parsing

ABSTRACT

A method for image processing is disclosed. The method includes: obtaining an image associated with a check; obtaining target strings associated with a payor of the check and based on a user input; obtaining extracted strings by applying multiple optical character recognition (OCR) processes with different segmentation modes to the image; identifying, using an expandable and sliding window (ESW), matches between the plurality of target strings and the plurality of extracted strings; and selecting a winning match from the plurality of matches.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority under 35 U.S.C. § 119(e) to U.S.Provisional Patent Application No. 62/769,490, which filed on Nov. 19,2018. U.S. Provisional Patent Application No. 62/769,490 is herebyincorporated by reference in its entirety.

This application is related to U.S. patent application Ser. No.16/295,740, which filed on Mar. 7, 2019. U.S. patent application Ser.No. 16/295,740 is hereby incorporated by reference in its entirety.

BACKGROUND

An optical character recognition (OCR) process is executed upon an imageto extract strings (i.e., text characters) from the image. An OCRprocess may operate in one of multiple segmentation modes. Differentsegmentation modes correspond to different presumptions regarding thetextural structure of the image. For example, one segmentation mode maypresume the image is a single column of text, while a differentsegmentation mode may presume the image has multiple columns of text.

OCR is frequently performed on images of paper checks. However, theseimages likely contains noise, distortions, and/or other OCRuncertainties. Moreover, a check does not possess a regular textstructure that is consistent across all checks. Accordingly, no singlesegmentation mode is guaranteed to produce the most accurate results(i.e., the most accurate extracted strings) especially for unconstrainedimages containing information besides just the check. Regardless, it isstill common to perform OCR on images of checks.

SUMMARY

In general, in one aspect, one or more embodiments relate to a methodfor image processing. The method comprises: obtaining an imageassociated with a check; obtaining a plurality of target stringsassociated with a payor of the check and based on a user input;obtaining a plurality of extracted strings by applying a plurality ofoptical character recognition (OCR) processes with differentsegmentation modes to the image; identifying, using an expandable andsliding window (ESW), a plurality of matches between the plurality oftarget strings and the plurality of extracted strings; and selecting awinning match from the plurality of matches.

In general, in one aspect, one or more embodiments relate to a systemfor image processing. The system comprises: a repository storing animage associated with a check; a target string engine that generates aplurality of target strings associated with a payor of the check andbased on a user input; an optical character recognition (OCR) enginethat obtains a plurality of extracted strings by applying a plurality ofOCR processes with different segmentation modes to the image; a matchingengine that identifies, using an expandable and sliding window (ESW), aplurality of matches between the plurality of target strings and theplurality of extracted strings; and a verification engine that selects awinning match from the plurality of matches.

In general, in one aspect, one or more embodiments relate to anon-transitory computer readable medium (CRM) storing instructions forimage processing. The instructions, when executed by a computerprocessor, comprising functionality for: obtaining an image associatedwith a check; obtaining a plurality of target strings associated with apayor of the check and based on a user input; obtaining a plurality ofextracted strings by applying a plurality of optical characterrecognition (OCR) processes with different segmentation modes to theimage; identifying, using an expandable and sliding window (ESW), aplurality of matches between the plurality of target strings and theplurality of extracted strings; and selecting a winning match from theplurality of matches.

Other aspects of the embodiments will be apparent from the followingdescription and the appended claims.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 shows a system in accordance with one or more embodiments of theinvention.

FIGS. 2-4 show flowcharts in accordance with one or more embodiments ofthe invention.

FIG. 5 shows an example in accordance with one or more embodiments ofthe invention.

FIG. 6A and FIG. 6B show a computer system in accordance with one ormore embodiments of the invention.

DETAILED DESCRIPTION

Specific embodiments of the invention will now be described in detailwith reference to the accompanying figures. Like elements in the variousfigures are denoted by like reference numerals for consistency.

In the following detailed description of embodiments of the invention,numerous specific details are set forth in order to provide a morethorough understanding of the invention. However, it will be apparent toone of ordinary skill in the art that the invention may be practicedwithout these specific details. In other instances, well-known featureshave not been described in detail to avoid unnecessarily complicatingthe description.

Throughout the application, ordinal numbers (e.g., first, second, third,etc.) may be used as an adjective for an element (i.e., any noun in theapplication). The use of ordinal numbers is not to imply or create anyparticular ordering of the elements nor to limit any element to beingonly a single element unless expressly disclosed, such as by the use ofthe terms “before”, “after”, “single”, and other such terminology.Rather, the use of ordinal numbers is to distinguish between theelements. By way of an example, a first element is distinct from asecond element, and the first element may encompass more than oneelement and succeed (or precede) the second element in an ordering ofelements.

Embodiments are directed towards obtaining user input regarding a check,obtaining one or more target strings based on the user input, and thenextracting multiple strings from an image of the check using differentsegmentation modes of an OCR process. Matches between the extractedstrings and the target strings are identified using an expandable andsliding window (ESW). The winning match (e.g., the match with thehighest score) may be used to verify the user who provided the userinput is the owner of the check. Accordingly, one or more embodimentsare directed towards improvements in the technical fields of at leastuser authentication and image processing.

FIG. 1 shows a system (100) in accordance with one or more embodiments.The system (100) has multiple components including a repository (105), atarget string engine (120), an OCR engine (130), a matching engine(140), a verification engine (150), and a graphical user interface (GUI)(160). Each of these components (105, 120, 130, 140, 150, 160) mayexecute on the same computing device (e.g., server, personal computer(PC), laptop, smart phone, tablet PC, etc.) or may execute on differentcomputing devices connected by a network (e.g., the Internet) havingwired and/or wireless segments. Moreover, each component (105, 120, 130,140, 150, 160) may be implemented in hardware (i.e., circuitry), insoftware, or in any combination of hardware and software.

In one or more embodiments, the repository (105) corresponds to any typeof database, any type of memory (e.g., main memory, cache memory, etc.),and/or any type of permanent storage device (e.g., hard drive, flashdrive, tape, etc.). Moreover, the repository (105) may correspond tomultiple storage devices located at the same location or at differentlocations.

In one or more embodiments, the repository stores an image (110). Theimage (110) may have been acquired by a camera of a mobile device (e.g.,smart phone, tablet PC, etc.). The image (110) may have been obtainedover a computer network. In one or more embodiments, the image (110)includes a check with multiple fields (e.g., payor name, payor address,fraction code, check number, etc.). Some image processing (e.g.,cropping, rotation, deskewing, scaling, etc.) may be performed on theimage (110) such that noise is reduced, distortion is reduced, the checkis horizontal or almost horizontal within the image (110), and/or thecheck is the only item within the image (110).

In one or more embodiments of the invention, the GUI (160) includes oneor more GUI widgets (e.g., text boxes, drop down boxes, buttons, radiobuttons, etc.). The GUI (160) is configured to obtain user input via oneor more of the GUI widgets. The user input may specify one or more ofthe payor's name, payor's address, fraction code, check number, etc.associated with the check in the image (110). The user input maycorrespond to a single string (e.g., “first name+middle name+last name”)or multiple strings (e.g., “first name”, “middle name”, “last name”).When the user input is initially obtained, it has not yet been verifiedwhether the user input actually corresponds to what is printed on thecheck in the image (110). As an example, a user applying for a personalloan might send an image of a check to indicate proof of banking detailsalongside entering some of the information, such as applicant's name, inthe aforementioned GUI.

In one or more embodiments of the invention, the user input may specifya different, but valid, payor name from the payor name printed on thecheck in the image (110). This might occur if the payor goes by anickname, or because the payor has a joint checking account with apartner or spouse, and thus the partner's name or spouse's name is alsoprinted on the check in the image (110). For example, the payor's namemight be “James Bond”. However, “James and Sarah Bond” may be printed oncheck in the image (110) or “Jim and Sarah Bond”.

In one or more embodiments of the invention, the target string engine(120) is configured to generate one or more target strings (133) basedon the user input. The target strings (133) may be generated byconverting the user input according to target string templates (e.g.,“First Last”, “First Middle_Initial Last”, “First_nickname Last”, etc.)learned by observing naming patterns over a large body of labeledchecks. In one or more embodiments, generating the target strings (133)may include accessing a lookup table (122) that inputs a string (e.g., afirst name) and outputs interchangeable strings (e.g., nicknames). Forexample, if the user input is “Rob Edward Smith”, possible targetstrings (133) include “R. Smith”, “Robert Smith”, “Bobby Smith”, “BobSmith”, “Rob Ed. Smith”, etc. In one or more embodiments, the userinput, without any modifications, is also considered to be one of thetarget strings (133).

In one or more embodiments, the OCR engine (130) is configured togenerate extracted strings (135) by executing one or more OCR processeson the image (110). The extracted strings (135) may correspond to one ormore of the payor name, payor address, fraction code, check number, etc.printed on the check in the image (110). Each OCR process may operateaccording to a different segmentation mode, and each segmentation modecorresponds to different presumptions regarding the textural structureof the image (110). For example, one segmentation mode may presume theimage (110) is a single column of text, while a different segmentationmode may presume the image (110) has multiple columns of text. Since acheck does not possess a regular text structure that is consistentacross all checks, no single segmentation mode is guaranteed to producethe most accurate extracted strings (135).

In one or more embodiments of the invention, the matching engine (140)is configured to identify matches between the target strings (133) andthe extracted strings (135). Identifying matches may include executing afuzzy text-matching technique that is tolerant of misaligned textboundaries and tolerant of missing or incorrect characters in theextracted strings (135). The matches may be assigned scores (135)reflecting the quality of the match.

In one or more embodiments, the matching engine (140) includes anexpandable and sliding window (ESW) (142) for use in identifyingmatches. The ESW (142) may correspond to a grouping of consecutivecharacters (in an extracted string) selected for comparing/scoring withone of the target strings (133). For example, if the ESW (142) is ofsize N, the ESW (142) groups N consecutive characters of the extractedstring for comparing/scoring with one of the target strings (133). TheESW (142) may be increased in size (e.g., from N to N+1, N+1 to N+2,etc.). Additionally or alternatively, the ESW (142) may slide along theextracted string, effectively changing which set of consecutivecharacters in the extracted string are being grouped forcomparing/scoring with one of the target strings (133). Additionaldetails regarding operation of the matching engine (140), the use of theESW (142), and the calculation of the scores (135) are discussed below.

In one or more embodiments of the invention, the verification engine(150) is configured to verify the user input. In one or moreembodiments, verification is the process of confirming (to an acceptabledegree of confidence as identified by business risk rules) that thepayor name provided via user input is the same as the name on the check.The verification process may include identifying the winning match(e.g., the match with the highest score of scores (135)). If thishighest score satisfies (e.g., equals or exceeds) a threshold, the userinput (and the user that provided the user input) is deemed to beverified. Additionally or alternatively, the highest score may bereported to another application executing one or more additionalverification processes.

Although the system (100) in FIG. 1 is shown as having six components(105, 120, 130, 140, 150, 160), in other embodiments, the system (100)may have additional components and/or some of the shown components (105,120, 130, 140, 150, 160) may be merged into a single component.

FIG. 2 depicts a flowchart in accordance with one or more embodiments.One or more steps of the flowchart may be performed by one or morecomponents of system (100), discussed above in reference to FIG. 1. Inone or more embodiments, one or more of the steps shown in FIG. 2 may beomitted, repeated, and/or performed in a different order than the ordershown in FIG. 2. Accordingly, the scope of the invention should not beconsidered limited to the specific arrangement of steps shown in FIG. 2.

In STEP 203, an image is obtained. The image may be obtained from acamera attached to a mobile device and/or downloaded over the Internet.The image includes a paper check with one or more of the payor's name,payor's address, fraction code, check number printed on the check. Imageprocessing may be performed on the image to reduce noise, reducedistortion, rotate the check to be horizontal (or almost horizontal)within the image, and/or crop items other than the check from the image.

In STEP 205, target strings associated with the payor of the check areobtained. Specifically, user input specifying one or more of the payor's name, payor's address, fraction code, check number, etc. associatedwith the check in the image may first be obtained via a GUI. The userinput may correspond to a single string (e.g., “first name+middlename+last name”) or multiple strings (e.g., “first name”, “middle name”,“last name”). When the user input is initially obtained, it has not yetbeen verified whether the user input actually corresponds to what isprinted on the check in the image. The target strings may be generatedby converting the user input accordingly to target string templates(e.g., “First Last”, “First Middle_Initial Last”, “First_nickname Last”,etc.). In one or more embodiments, generating the target strings mayinclude accessing a lookup table that inputs a string (e.g., a firstname) and outputs interchangeable strings (e.g., nicknames). Forexample, if the user input is “Jimmy Stewart”, possible target stringsinclude “James Stewart”, “Jim Stewart”, “J. Stewart”, etc. In one ormore embodiments, the user input without any modifications (e.g., “JimmyStewart”) is also considered to be one of the target strings.

In STEP 207, the segmentation mode of an OCR process is selected. An OCRprocess may operate according to one of various segmentation modes, andeach segmentation mode corresponds to different presumptions regardingthe textural structure of the image. For example, one segmentation modemay presume the image is a single column of text, while a differentsegmentation mode may presume the image has multiple columns of text. Ifthis is the first execution of STEP 207, a segmentation mode may beselected at random. If this is not the first execution of STEP 207, asegmentation mode that has not yet been selected is chosen.

In STEP 209, extracted strings are obtained. The extracted strings maybe generated by applying the OCR process to the image. The extractedstrings may correspond to one or more of the payor name, payor address,fraction code, check number, etc. printed on the check in the image. Inone or more embodiments, the OCR process also returns locations (e.g.,coordinates) of the extracted strings within the image. For example, theOCR process may return the starting coordinates of each extracted stringwithin the image.

In STEP 211, matches between the targets strings and the extractedstrings are identified. Identifying matches may include executing afuzzy text-matching technique that is tolerant of misaligned textboundaries and tolerant of missing or incorrect characters in theextracted strings. Moreover, identifying matches may also includecalculating scores using the ESW. Additional details regardingidentifying matches are discussed below in reference to FIG. 3.

In STEP 213, it is determined whether at least one segmentation moderemains that has not yet been selected. When it is determined that thereexists at least one segmentation mode that has not yet been selected,the process returns to STEP 207. When it is determined that all thesegmentation modes have been selected or a sufficient number have beenselected, the process proceeds to STEP 215. As discussed above, since acheck does not possess a regular text structure that is consistentacross all checks, no single segmentation mode is guaranteed to producethe most accurate extracted strings in STEP 209. However, by executingthe OCR process multiple times with different segmentations modes, it ismore likely that one iteration of STEP 209 will generate accurateextracted strings.

In STEP 215, a winning match is selected. The winning match maycorrespond to the match with the highest calculated score. In STEP 217,the user input may be verified based on the winning match (e.g., thescore of the winning match must satisfy a threshold).

Although the description of FIG. 2 focuses heavily on target strings andextracted strings corresponding to the payor' s name on the check in theimage, the process in FIG. 2 may be also be executed for stringscorresponding to other content printed on the check in the image.

FIG. 3 depicts a flowchart in accordance with one or more embodiments ofthe invention. One or more steps of the flowchart may be performed byone or more components of system (100), discussed above in reference toFIG. 1. One or more of the steps in FIG. 3 may be correspond to STEP211, discussed above in reference to FIG. 2. In one or more embodiments,one or more of the steps shown in FIG. 3 may be omitted, repeated,and/or performed in a different order than the order shown in FIG. 3.Accordingly, the scope of the invention should not be considered limitedto the specific arrangement of steps shown in FIG. 3.

Before executing the process depicted in FIG. 3, multiple target stringsand multiple extracted strings have been obtained (discussed above inreference to STEP 205 and STEP 219). In STEP 301 and STEP 303, one ofthe target strings is selected and one of extracted strings is selected,respectively. The target string and the extracted string may havedifferent lengths (i.e., the target string may have a different numberof characters than the extracted string).

In STEP 305, the ESW size is set to the size of the selected targetstring. In other words, if the target string is k characters in size,the ESW size is set to k characters. A blank space may be considered acharacter. For example, the target string “Mike Smith” has a size of 10.

In STEP 307, the ESW is positioned at the start of the selectedextracted string. In other words, if the ESW size is N, followingexecution of STEP 307 the ESW is now grouping the first N characters ofthe selected extracted string.

In STEP 309, the characters of the extracted string within the ESW arecompared with the target string and a score for these characters iscalculated. Additional details regarding calculation of the score arediscussed below in reference to FIG. 4. In one or more embodiments, amatch between the characters within the ESW and the selected targetstring is declared when the calculated score satisfies (e.g., equals orexceeds) a threshold. If the calculated score does not satisfy thethreshold, no match is declared.

In STEP 311, the ESW is shifted to the right by one along the extractedstring. Accordingly, if the ESW was previously grouping characters βthrough Φ of the extracted string, following STEP 311, the ESW is nowgrouping characters (β+1) through (Φ+1) of the extracted string.

In STEP 312 it is determined whether the ESW is out of bounds. In otherwords, it is determined whether the ESW extends beyond the extractedstring. For example, if the ESW has a size of 3 and the startingposition of the ESW is now the second last character in the extractedstring, the ESW now extends beyond the extracted string. When it isdetermined that the ESW is not out of bounds, the process returns toSTEP 309. When it is determined that the ESW is out of bounds, theprocess proceeds to STEP 314.

In STEP 314, it is determined whether the size of the ESW exceeds athreshold. For example, the threshold may equal the size of the selectedtarget string+3 (or another other whole number). As another example, thethreshold may equal the size of the target string×1.5 (or anotherpositive value in excess of 1), rounded to the nearest natural number.When it is determined that the size of the ESW exceeds a threshold, theprocess proceeds to STEP 318. When it is determined that the size of theESW does not exceed the threshold, the process proceeds to STEP 316.

In STEP 316, the size of the ESW is incremented. Accordingly, if thesize of the ESW was N, following execution of STEP 316 the size of theESW becomes N+1, and the process returns to STEP 307. Alternatively,each execution of STEP 316 may increase the size of the ESW by more thanone.

In STEP 318, if the selected target string is composed of multiple words(e.g., a first name and a last name), the selected target string may bepartitioned into its multiple words. This might be necessary because thename on the check contains a middle initial whereas the name submittedfor verification does not. Or it might be necessary because of OCRartifacts that introduce spurious characters into the target string suchthat matching on the entire name will produce a low score over areasonable window length (ESW). For each of the multiple words, STEPS305-314 may be repeated while treating one of the multiple words as thetarget string. Once the highest scoring match (i.e., set of charactersin the extracted string) for each of the words is determined, thedistance between these matches may be determined so as to avoid thepotential of matching individual words that are far apart in the targetstring and so unlikely to constitute the full name being sought (e.g.if, say, the surname appears later or elsewhere on the check or even aspart of the bank name). A small distance (i.e., a distance that is lessthan a distance threshold) indicates the matches are geometrically closeand thus are more likely to correspond to the target string that waspartitioned. In contrast, if the distance equals or exceeds the distancethreshold, it is likely the matches do not correspond to the targetstring that was partitioned.

Still referring to STEP 318, when the distance is small, a compositescore is calculated based on the high score matches for the words andthe distance. A match between the target string (before it waspartitioned) and the selected extracted string is declared whencomposite score satisfies a threshold. The composite score may be one ofthe scores (135), discussed above in reference to FIG. 1. One method ofcalculating the composite score is calculate the averages of theindividual scores and compare to a threshold. Additionally, we mightweight the individual scores when averaging by taking into account theprior probabilities of the words in terms of how likely a word, orsomething similar, is to appear in the target string to begin with. Forwords more likely to appear, such as common nicknames (versus rare ones)then we should add a lower weight since the chances of misidentifyingthe word are higher for more common words. For example, the word “Bob”might have a lower weighting applied if there are a lot of expectedoccurrences of that word due to it being a common name, or words thatare close to it like “Rob”. In other words, the chances of confusing“Bob” with “Rob” are high and so we should apply a lower weighting toits score to represent that we are less confident in mismatches. Whereasthe word “Petulia” is relatively rare in terms of word frequencies andso we might be more relaxed with its score and apply a higher weightingto say a mismatch like “Petunio” (two wrong characters) because thechances of finding a similar name that would fit this mismatch, orthereabouts, are relatively low.

Although the description of FIG. 3 focuses heavily on target strings andextracted strings corresponding to the payor's name on the check in theimage, the process in FIG. 3 may be also be executed for stringscorresponding to other content printed on the check in the image.Moreover, the process depicted in FIG. 3 may be repeated until everyextracted string is searched for matches with every target string.

FIG. 4 depicts a flowchart in accordance with one or more embodiments ofthe invention. One or more steps of the flowchart may be performed byone or more components of system (100), discussed above in reference toFIG. 1. One or more of the steps in FIG. 4 may be correspond to Step309, discussed above in reference to FIG. 3. In one or more embodiments,one or more of the steps shown in FIG. 4 may be omitted, repeated,and/or performed in a different order than the order shown in FIG. 4.Accordingly, the scope of the invention should not be considered limitedto the specific arrangement of steps shown in FIG. 4.

Prior to executing the process depicted in FIG. 4, a target string andan extracted string have been selected, and the ESW is groupingconsecutive characters of the extracted string.

In STEP 405, a search is conducted for one or more blocks of consecutivecharacters (i.e., 2 or more characters) within the ESW that correspondto substrings of the target string. For example, if the target string is“John”, then a search is conducted for the following blocks: “Jo”,“Joh”, “ohn” “hn”, and “John”. If the characters within the ESW are“Jo***hn”, then the search returns the blocks “Jo” and “hn”. If thecharacters within the ESW are “J***ohn”, then the search returns theblock “ohn”. If the characters within the ESW are “***John***”, then thesearch returns the block “John”. In one or more embodiments, if multipleblocks overlap, the search returns the largest block. In one or moreembodiments, searching includes stepping through the characters of theESW and the characters of the target string without backtracking througheither the ESW or the target string. As a result, if the characterswithin the ESW are “**hn**Jo**”, then the search only returns the block“hn”. Although both “hn” and “Jo” are substrings of the target string,“Jo” is never found after “hn” within the target string. In one or moreembodiments, searching does not find strings out of order. If “ohn”comes before “joh”, the searching will only match “ohn” or “joh” and noton “john”.

In STEP 407, it is determined whether at least one block was returned bythe search. When it is determined that at least one block is returned,the process proceeds to STEP 410. When it is determined that no blockhas been returned, the process may end and report no matches identified.

In STEP 410, a match length is calculated. The match length may becalculated by summing the lengths of individual blocks returned by thesearch. For example, if the search returned the blocks of “Jo” and “hn”,then the match length would be 2+2=4. If the search returns a singleblock, the match length is set to the length of the single block. Forexample, if the single block “ohn” is returned by the search, the matchlength is set to 3.

In STEP 415, a divisor is calculated. The divisor may be calculated bysumming the size of the ESW and the size of the target string. In STEP420, a quotient is calculated by dividing the match length by thedivisor. The quotient may correspond to the score. Additionally oralternatively, the quotient may be scaled by a constant (e.g.,2×quotient) (STEP 430) and the scaled quotient corresponds to the score.

Although the description of FIG. 4 focuses heavily on target strings andextracted strings corresponding to the payor' s name on the check in theimage, the process in FIG. 4 may be also be executed for stringscorresponding to other content printed on the check in the image.

FIG. 5 shows four examples in accordance with one or more embodiments ofthe invention: example A (510A), example B (510B), example C (510C),example D (510D). Each of the examples (510A-510D) corresponds to adifferent extracted string (i.e., extracted string A (550A), extractedstring B (550B), extracted string C (550C), extracted string D (550D)).Moreover, each of the examples (510A-510D) involves a different sizedESW (i.e., ESW A (505A), ESW B (505B), ESW C (505C), ESW D (505D)). Theexamples (510A-510D) correspond primarily to the score calculationdescribed in FIG. 4.

As shown in FIG. 5, each ESW (505A-505D) groups a set of consecutivecharacters within one of the extracted strings (550A-550D). Moreover,the characters in each ESW (505A-505D) are compared with the targetstring “MIKE” (599) and scored using equation (515).

In example A (510A), searching the characters within ESW A (505A) basedon the target string (599) returns the single block “MIKE”, which is asubstring of the target string (599). As there is only one block, thematch length is set to the size of the one block (i.e., match length=4).As the ESW has a size of 4 and the target string (599) has a size of 4,the score is calculated as 1.0 using the equation (515).

In example B (510B), searching the characters within ESW B (505B) basedon the target string (599) returns two blocks: “MI” and “KE”, which areboth substrings of the target string (599). The match length may becalculated by summing the lengths of the two blocks (i.e., matchlength=2+2=4). As the ESW has a size of 5 and the target string (599)has a size of 4, the score is calculated as 0.89 using the equation(515).

In example C (510C), searching the characters within ESW C (505C) basedon the target string (599) returns the single block “IKE”, which is asubstring of the target string (599). As there is only one block, thematch length is set to the size of the one block (i.e., match length=3).As the ESW has a size of 6 and the target string (599) has a size of 4,the score is calculated as 0.6 using the equation (515).

In example D (510D), searching the characters within ESW D (505D) basedon the target string (599) returns the single block “MI”, which is asubstring of the target string (599). As there is only one block, thematch length is set to the size of the one block (i.e., match length=2).As the ESW has a size of 7 and the target string (599) has a size of 4,the score is calculated as 0.36 using the equation (515).

While the various steps in the flowcharts are presented and describedsequentially, one of ordinary skill will appreciate that some or all ofthe steps may be executed in different orders, may be combined oromitted, and some or all of the steps may be executed in parallel.Furthermore, the steps may be performed actively or passively. Forexample, some steps may be performed using polling or be interruptdriven in accordance with one or more embodiments of the invention. Byway of an example, determination steps may not require a processor toprocess an instruction unless an interrupt is received to signify thatcondition exists in accordance with one or more embodiments of theinvention. As another example, determination steps may be performed byperforming a test, such as checking a data value to test whether thevalue is consistent with the tested condition in accordance with one ormore embodiments of the invention.

Embodiments of the invention may be implemented on a computing system.Any combination of mobile, desktop, server, router, switch, embeddeddevice, or other types of hardware may be used. For example, as shown inFIG. 6A, the computing system (600) may include one or more computerprocessors (602), non-persistent storage (604) (e.g., volatile memory,such as random access memory (RAM), cache memory), persistent storage(606) (e.g., a hard disk, an optical drive such as a compact disk (CD)drive or digital versatile disk (DVD) drive, a flash memory, etc.), acommunication interface (612) (e.g., Bluetooth interface, infraredinterface, network interface, optical interface, etc.), and numerousother elements and functionalities.

The computer processor(s) (602) may be an integrated circuit forprocessing instructions. For example, the computer processor(s) may beone or more cores or micro-cores of a processor. The computing system(600) may also include one or more input devices (610), such as atouchscreen, keyboard, mouse, microphone, touchpad, electronic pen, orany other type of input device.

The communication interface (612) may include an integrated circuit forconnecting the computing system (600) to a network (not shown) (e.g., alocal area network (LAN), a wide area network (WAN) such as theInternet, mobile network, or any other type of network) and/or toanother device, such as another computing device.

Further, the computing system (600) may include one or more outputdevices (608), such as a screen (e.g., a liquid crystal display (LCD), aplasma display, touchscreen, cathode ray tube (CRT) monitor, projector,or other display device), a printer, external storage, or any otheroutput device. One or more of the output devices may be the same ordifferent from the input device(s). The input and output device(s) maybe locally or remotely connected to the computer processor(s) (602),non-persistent storage (604), and persistent storage (606). Manydifferent types of computing systems exist, and the aforementioned inputand output device(s) may take other forms.

Software instructions in the form of computer readable program code toperform embodiments of the invention may be stored, in whole or in part,temporarily or permanently, on a non-transitory computer readable mediumsuch as a CD, DVD, storage device, a diskette, a tape, flash memory,physical memory, or any other computer readable storage medium.Specifically, the software instructions may correspond to computerreadable program code that, when executed by a processor(s), isconfigured to perform one or more embodiments of the invention.

The computing system (600) in FIG. 6A may be connected to or be a partof a network. For example, as shown in FIG. 6B, the network (620) mayinclude multiple nodes (e.g., node X (622), node Y (624)). Each node maycorrespond to a computing system, such as the computing system shown inFIG. 6A, or a group of nodes combined may correspond to the computingsystem shown in FIG. 6A. By way of an example, embodiments of theinvention may be implemented on a node of a distributed system that isconnected to other nodes. By way of another example, embodiments of theinvention may be implemented on a distributed computing system havingmultiple nodes, where each portion of the invention may be located on adifferent node within the distributed computing system. Further, one ormore elements of the aforementioned computing system (600) may belocated at a remote location and connected to the other elements over anetwork.

Although not shown in FIG. 6B, the node may correspond to a blade in aserver chassis that is connected to other nodes via a backplane. By wayof another example, the node may correspond to a server in a datacenter. By way of another example, the node may correspond to a computerprocessor or micro-core of a computer processor with shared memoryand/or resources.

The nodes (e.g., node X (622), node Y (624)) in the network (620) may beconfigured to provide services for a client device (626). For example,the nodes may be part of a cloud computing system. The nodes may includefunctionality to receive requests from the client device (626) andtransmit responses to the client device (626). The client device (626)may be a computing system, such as the computing system shown in FIG.6A. Further, the client device (626) may include and/or perform all or aportion of one or more embodiments of the invention.

The computing system or group of computing systems described in FIG. 6Aand 6B may include functionality to perform a variety of operationsdisclosed herein. For example, the computing system(s) may performcommunication between processes on the same or different system. Avariety of mechanisms, employing some form of active or passivecommunication, may facilitate the exchange of data between processes onthe same device. Examples representative of these inter-processcommunications include, but are not limited to, the implementation of afile, a signal, a socket, a message queue, a pipeline, a semaphore,shared memory, message passing, and a memory-mapped file. Furtherdetails pertaining to a couple of these non-limiting examples areprovided below.

Based on the client-server networking model, sockets may serve asinterfaces or communication channel end-points enabling bidirectionaldata transfer between processes on the same device. Foremost, followingthe client-server networking model, a server process (e.g., a processthat provides data) may create a first socket object. Next, the serverprocess binds the first socket object, thereby associating the firstsocket object with a unique name and/or address. After creating andbinding the first socket object, the server process then waits andlistens for incoming connection requests from one or more clientprocesses (e.g., processes that seek data). At this point, when a clientprocess wishes to obtain data from a server process, the client processstarts by creating a second socket object. The client process thenproceeds to generate a connection request that includes at least thesecond socket object and the unique name and/or address associated withthe first socket object. The client process then transmits theconnection request to the server process. Depending on availability, theserver process may accept the connection request, establishing acommunication channel with the client process, or the server process,busy in handling other operations, may queue the connection request in abuffer until server process is ready. An established connection informsthe client process that communications may commence. In response, theclient process may generate a data request specifying the data that theclient process wishes to obtain. The data request is subsequentlytransmitted to the server process. Upon receiving the data request, theserver process analyzes the request and gathers the requested data.Finally, the server process then generates a reply including at leastthe requested data and transmits the reply to the client process. Thedata may be transferred, more commonly, as datagrams or a stream ofcharacters (e.g., bytes).

Shared memory refers to the allocation of virtual memory space in orderto substantiate a mechanism for which data may be communicated and/oraccessed by multiple processes. In implementing shared memory, aninitializing process first creates a shareable segment in persistent ornon-persistent storage. Post creation, the initializing process thenmounts the shareable segment, subsequently mapping the shareable segmentinto the address space associated with the initializing process.Following the mounting, the initializing process proceeds to identifyand grant access permission to one or more authorized processes that mayalso write and read data to and from the shareable segment. Changes madeto the data in the shareable segment by one process may immediatelyaffect other processes, which are also linked to the shareable segment.Further, when one of the authorized processes accesses the shareablesegment, the shareable segment maps to the address space of thatauthorized process. Often, only one authorized process may mount theshareable segment, other than the initializing process, at any giventime.

Other techniques may be used to share data, such as the various datadescribed in the present application, between processes withoutdeparting from the scope of the invention. The processes may be part ofthe same or different application and may execute on the same ordifferent computing system.

Rather than or in addition to sharing data between processes, thecomputing system performing one or more embodiments of the invention mayinclude functionality to receive data from a user. For example, in oneor more embodiments, a user may submit data via a graphical userinterface (GUI) on the user device. Data may be submitted via thegraphical user interface by a user selecting one or more graphical userinterface widgets or inserting text and other data into graphical userinterface widgets using a touchpad, a keyboard, a mouse, or any otherinput device. In response to selecting a particular item, informationregarding the particular item may be obtained from persistent ornon-persistent storage by the computer processor. Upon selection of theitem by the user, the contents of the obtained data regarding theparticular item may be displayed on the user device in response to theuser's selection.

By way of another example, a request to obtain data regarding theparticular item may be sent to a server operatively connected to theuser device through a network. For example, the user may select auniform resource locator (URL) link within a web client of the userdevice, thereby initiating a Hypertext Transfer Protocol (HTTP) or otherprotocol request being sent to the network host associated with the URL.In response to the request, the server may extract the data regardingthe particular selected item and send the data to the device thatinitiated the request. Once the user device has received the dataregarding the particular item, the contents of the received dataregarding the particular item may be displayed on the user device inresponse to the user's selection. Further to the above example, the datareceived from the server after selecting the URL link may provide a webpage in Hyper Text Markup Language (HTML) that may be rendered by theweb client and displayed on the user device.

Once data is obtained, such as by using techniques described above orfrom storage, the computing system, in performing one or moreembodiments of the invention, may extract one or more data items fromthe obtained data. For example, the extraction may be performed asfollows by the computing system in FIG. 6A. First, the organizingpattern (e.g., grammar, schema, layout) of the data is determined, whichmay be based on one or more of the following: position (e.g., bit orcolumn position, Nth token in a data stream, etc.), attribute (where theattribute is associated with one or more values), or a hierarchical/treestructure (consisting of layers of nodes at different levels ofdetail-such as in nested packet headers or nested document sections).Then, the raw, unprocessed stream of data symbols is parsed, in thecontext of the organizing pattern, into a stream (or layered structure)of tokens (where each token may have an associated token “type”).

Next, extraction criteria are used to extract one or more data itemsfrom the token stream or structure, where the extraction criteria areprocessed according to the organizing pattern to extract one or moretokens (or nodes from a layered structure). For position-based data, thetoken(s) at the position(s) identified by the extraction criteria areextracted. For attribute/value-based data, the token(s) and/or node(s)associated with the attribute(s) satisfying the extraction criteria areextracted. For hierarchical/layered data, the token(s) associated withthe node(s) matching the extraction criteria are extracted. Theextraction criteria may be as simple as an identifier string or may be aquery presented to a structured data repository (where the datarepository may be organized according to a database schema or dataformat, such as XML).

The extracted data may be used for further processing by the computingsystem. For example, the computing system of FIG. 6A, while performingone or more embodiments of the invention, may perform data comparison.Data comparison may be used to compare two or more data values (e.g., A,B). For example, one or more embodiments may determine whether A>B, A=B,A !=B, A<B, etc. The comparison may be performed by submitting A, B, andan opcode specifying an operation related to the comparison into anarithmetic logic unit (ALU) (i.e., circuitry that performs arithmeticand/or bitwise logical operations on the two data values). The ALUoutputs the numerical result of the operation and/or one or more statusflags related to the numerical result. For example, the status flags mayindicate whether the numerical result is a positive number, a negativenumber, zero, etc. By selecting the proper opcode and then reading thenumerical results and/or status flags, the comparison may be executed.For example, in order to determine if A>B, B may be subtracted from A(i.e., A−B), and the status flags may be read to determine if the resultis positive (i.e., if A>B, then A−B>0). In one or more embodiments, Bmay be considered a threshold, and A is deemed to satisfy the thresholdif A=B or if A >B, as determined using the ALU. In one or moreembodiments of the invention, A and B may be vectors, and comparing Awith B requires comparing the first element of vector A with the firstelement of vector B, the second element of vector A with the secondelement of vector B, etc. In one or more embodiments, if A and B arestrings, the binary values of the strings may be compared.

The computing system in FIG. 6A may implement and/or be connected to adata repository. For example, one type of data repository is a database.A database is a collection of information configured for ease of dataretrieval, modification, re-organization, and deletion. DatabaseManagement System (DBMS) is a software application that provides aninterface for users to define, create, query, update, or administerdatabases.

The user, or software application, may submit a statement or query intothe DBMS. Then the DBMS interprets the statement. The statement may be aselect statement to request information, update statement, createstatement, delete statement, etc. Moreover, the statement may includeparameters that specify data, or data container (database, table,record, column, view, etc.), identifier(s), conditions (comparisonoperators), functions (e.g. join, full join, count, average, etc.), sort(e.g. ascending, descending), or others. The DBMS may execute thestatement. For example, the DBMS may access a memory buffer, a referenceor index a file for read, write, deletion, or any combination thereof,for responding to the statement. The DBMS may load the data frompersistent or non-persistent storage and perform computations to respondto the query. The DBMS may return the result(s) to the user or softwareapplication.

The computing system of FIG. 6A may include functionality to present rawand/or processed data, such as results of comparisons and otherprocessing. For example, presenting data may be accomplished throughvarious presenting methods. Specifically, data may be presented througha user interface provided by a computing device. The user interface mayinclude a GUI that displays information on a display device, such as acomputer monitor or a touchscreen on a handheld computer device. The GUImay include various GUI widgets that organize what data is shown as wellas how data is presented to a user. Furthermore, the GUI may presentdata directly to the user, e.g., data presented as actual data valuesthrough text, or rendered by the computing device into a visualrepresentation of the data, such as through visualizing a data model.

For example, a GUI may first obtain a notification from a softwareapplication requesting that a particular data object be presented withinthe GUI. Next, the GUI may determine a data object type associated withthe particular data object, e.g., by obtaining data from a dataattribute within the data object that identifies the data object type.Then, the GUI may determine any rules designated for displaying thatdata object type, e.g., rules specified by a software framework for adata object class or according to any local parameters defined by theGUI for presenting that data object type. Finally, the GUI may obtaindata values from the particular data object and render a visualrepresentation of the data values within a display device according tothe designated rules for that data object type.

Data may also be presented through various audio methods. In particular,data may be rendered into an audio format and presented as sound throughone or more speakers operably connected to a computing device.

Data may also be presented to a user through haptic methods. Forexample, haptic methods may include vibrations or other physical signalsgenerated by the computing system. For example, data may be presented toa user using a vibration generated by a handheld computer device with apredefined duration and intensity of the vibration to communicate thedata.

The above description of functions present only a few examples offunctions performed by the computing system of FIG. 6A and the nodesand/or client device in FIG. 6B. Other functions may be performed usingone or more embodiments of the invention.

While the invention has been described with respect to a limited numberof embodiments, those skilled in the art, having benefit of thisdisclosure, will appreciate that other embodiments can be devised whichdo not depart from the scope of the invention as disclosed herein.Accordingly, the scope of the invention should be limited only by theattached claims.

What is claimed is:
 1. A method for image processing, comprising:obtaining an image associated with a check; obtaining a plurality oftarget strings associated with a payor of the check and based on a userinput; obtaining a plurality of extracted strings by applying aplurality of optical character recognition (OCR) processes withdifferent segmentation modes to the image; identifying, using anexpandable and sliding window (ESW), a plurality of matches between theplurality of target strings and the plurality of extracted strings,wherein identifying the plurality of matches comprises: selecting atarget string of the plurality of target strings, selecting an extractedstring of the plurality of extracted strings, calculating, based on thetarget string, a first score for a first plurality of characters of theextracted string within the ESW, incrementing a size of the ESW, andcalculating, after increasing the size of the ESW and based on thetarget string, a second score for a second plurality of characters ofthe extracted string within the ESW; and selecting a winning match fromthe plurality of matches.
 2. The method of claim 1, further comprising:verifying the user input based on a score of the winning match.
 3. Themethod of claim 1, further comprising: obtaining the user inputspecifying a nickname and a last name of the payor; obtaining a firstname based on the nickname; and generating at least one of the pluralityof target strings based on the first name and the last name.
 4. Themethod of claim 1, wherein calculating the first score comprises:identifying, within the first plurality of characters, a block ofconsecutive characters corresponding to a substring of the targetstring; setting a match length to the length of the block; calculating adivisor by summing the size of the ESW and a size of the target string;and calculating a quotient by dividing the match length by the divisor,wherein the first score comprises a scaled version of the quotient. 5.The method of claim 1, wherein calculating the second score comprises:identifying, within the second plurality of characters, a plurality ofblocks of consecutive characters corresponding to a plurality ofsubstrings of the target string, wherein the plurality of blockscomprises a plurality of lengths; calculating a match length by summingthe plurality of lengths; calculating a divisor by summing of the sizeof the ESW and a size of the target string; and calculating a quotientby dividing of the match length by the divisor, wherein the second scorecomprises a scaled version of the quotient.
 6. The method of claim 1,further comprising: setting, before calculating the first score, thesize of the ESW to equal the size of the target string.
 7. The method ofclaim 1, further comprising: partitioning the target string into a firstword and a second word; calculating, based on the first word, a thirdscore for a third plurality of characters of the extracted string withinthe ESW; calculating, based on the second word, a fourth score for afourth plurality of characters of the extracted string within the ESW;determining a distance between the third plurality of characters and thefourth plurality of characters within the extracted string; comparingthe distance with a distance threshold; and calculating, in response tothe distance being less than the distance threshold, a composite scorebased on the third score and the fourth score.
 8. A system for imageprocessing, comprising: a repository storing an image associated with acheck; a target string engine that generates a plurality of targetstrings associated with a payor of the check and based on a user input;an optical character recognition (OCR) engine that obtains a pluralityof extracted strings by applying a plurality of OCR processes withdifferent segmentation modes to the image; a matching engine thatidentifies, using an expandable and sliding window (ESW), a plurality ofmatches between the plurality of target strings and the plurality ofextracted strings wherein to identify the plurality of matches, thematching engine: selects a target string of the plurality of targetstrings, selects an extracted string of the plurality of extractedstrings, calculates, based on the target string, a first score for afirst plurality of characters of the extracted string within the ESW,increments a size of the ESW, and calculates, after increasing the sizeof the ESW and based on the target string, a second score for a secondplurality of characters of the extracted string within the ESW; and averification engine that selects a winning match from the plurality ofmatches.
 9. The system of claim 8, comprising: a graphical userinterface (GUI) comprising at least one widget that obtains the userinput, wherein the verification engine also verifies the user inputbased on a score of the winning match.
 10. The system of claim 8,wherein calculating the first score comprises: identifying, within thefirst plurality of characters, a block of consecutive characterscorresponding to a substring of the target string; setting a matchlength to the length of the block; calculating a divisor by summing thesize of the ESW and a size of the target string; and calculating aquotient by dividing the match length by the divisor, wherein the firstscore comprises a scaled version of the quotient.
 11. The system ofclaim 8, wherein calculating the second score comprises: identifying,within the second plurality of characters, a plurality of blocks ofconsecutive characters corresponding to a plurality of substrings of thetarget string, wherein the plurality of blocks comprises a plurality oflengths; calculating a match length by summing the plurality of lengths;calculating a divisor by summing of the size of the ESW and a size ofthe target string; and calculating a quotient by dividing of the matchlength by the divisor, wherein the second score comprises a scaledversion of the quotient.
 12. The system of claim 8, wherein the matchingengine also: partitions the target string into a first word and a secondword; calculates, based on the first word, a third score for a thirdplurality of characters of the extracted string within the ESW;calculates, based on the second word, a fourth score for a fourthplurality of characters of the extracted string within the ESW;determines a distance between the third plurality of characters and thefourth plurality of characters within the extracted string; compares thedistance with a distance threshold; and calculates, in response to thedistance being less than the distance threshold, a composite score basedon the third score and the fourth score.
 13. A non-transitory computerreadable medium (CRM) storing instructions for image processing, theinstructions, when executed by a computer processor, comprisingfunctionality for: obtaining an image associated with a check; obtaininga plurality of target strings associated with a payor of the check andbased on a user input; obtaining a plurality of extracted strings byapplying a plurality of optical character recognition (OCR) processeswith different segmentation modes to the image; identifying, using anexpandable and sliding window (ESW), a plurality of matches between theplurality of target strings and the plurality of extracted strings,wherein identifying the plurality of matches comprises: selecting atarget string of the plurality of target strings, selecting an extractedstring of the plurality of extracted strings, calculating, based on thetarget string, a first score for a first plurality of characters of theextracted string within the ESW, increment a size of the ESW, andcalculating, after increasing the size of the ESW and based on thetarget string, a second score for a second plurality of characters ofthe extracted string within the ESW; and selecting a winning match fromthe plurality of matches.
 14. The non-transitory CRM of claim 13,wherein calculating the first score comprises: identifying, within thefirst plurality of characters, a block of consecutive characterscorresponding to a substring of the target string; setting a matchlength to the length of the block; calculating a divisor by summing thesize of the ESW and a size of the target string; and calculating aquotient by dividing the match length by the divisor, wherein the firstscore comprises a scaled version of the quotient.
 15. The non-transitoryCRM of claim 13, wherein calculating the second score comprises:identifying, within the second plurality of characters, a plurality ofblocks of consecutive characters corresponding to a plurality ofsubstrings of the target string, wherein the plurality of blockscomprises a plurality of lengths; calculating a match length by summingthe plurality of lengths; calculating a divisor by summing of the sizeof the ESW and a size of the target string; and calculating a quotientby dividing of the match length by the divisor, wherein the second scorecomprises a scaled version of the quotient.
 16. The non-transitory CRMof claim 13, the instructions further comprising functionality for:partitioning the target string into a first word and a second word;calculating, based on the first word, a third score for a thirdplurality of characters of the extracted string within the ESW;calculating, based on the second word, a fourth score for a fourthplurality of characters of the extracted string within the ESW;determining a distance between the third plurality of characters and thefourth plurality of characters within the extracted string; comparingthe distance with a distance threshold; and calculating, in response tothe distance being less than the distance threshold, a composite scorebased on the third score, the fourth score, and the distance.